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This  report  provides  teachers,  school  administrators,  and  the  public  with  an  overview  of  the  results  for  the 
June  1995  Grade  6 English  Language  Arts  provincial  assessment.  It  complements  the  detailed  school  and 
jurisdiction  reports. 
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“the  percentage  of  students  in  the  province  who 
met  the  standards  (based  on  those  who  wrote) 


Who  Wrote  the  Test? 

All  students  registered  in  Grade  6 were  expected  to  write  the 
1995  English  Language  Arts  Achievement  Test.  A total  of 
39  428  students  completed  the  June  1995  assessment.  This 
number  reflects  an  increase  of  approximately  5 000  students 
over  the  last  administration  of  the  test  in  1992.  In  1995, 
only  a small  proportion  of  students  in  Grade  6 did  not  write 
the  test:  0.9%  of  students  were  absent,  1.7%  of  students  were 
excused  from  writing  by  their  superintendent,  and  an 
additional  2%  of  students  wrote  only  one  part  of  the  test. 

What  Was  the  Test  Like? 

The  test  had  two  parts. 

Part  A:  Writing  provided  students  with  a picture  and  a brief 
explanation  as  a prompt  for  their  writing.  Students  chose 
the  format  (narrative,  letter,  diary/joumal  entries)  that 
would  allow  them  to  do  their  best  writing.  This  part  of  the 
test  was  scored  in  five  categories:  Content,  Organization, 
Sentence  Structure,  Vocabulary,  and  Conventions.  Content 
and  Organization  were  weighted  to  be  worth  twice  as  much 
as  each  of  the  other  categories. 

Part  B:  Reading  consisted  of  50  multiple-choice  questions 
based  on  reading  selections  from  fiction,  non-fiction,  drama, 
poetry,  and  visual  media. 

How  Well  Did  Students  Do? 

In  writing,  not  as  many  students  as  expected  met  the 
acceptable  standard  or  the  standard  of  excellence.  In 
reading,  not  as  many  students  as  expected  met  the 
acceptable  standard,  but  4.7%  more  students  than  expected 
met  the  standard  of  excellence.  For  the  total  test,  fewer 
students  than  expected  met  either  standard. 

In  7.0%  of  the  schools,  the  percentage  of  students  meeting 
the  acceptable  standard  for  the  total  test  was  significantly 
above  expectations  for  the  province.  In  67.1%  of  the  schools, 
the  percentage  of  students  meeting  the  acceptable  standard 
was  not  significantly  different  from  provincial  expectations. 
In  25.9%  of  schools,  the  percentage  of  students  meeting  the 
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acceptable  standard  was  significantly  below  provincial  expectations.  Schools  where  fewer  than  five  students 
wrote  the  Grade  6 test  are  not  included  in  the  calculations. 

Detailed  provincial  assessment  results  are  provided  in  school  and  jurisdiction  reports. 

Has  Achievement  Changed  Since  1988? 

A special  study  of  changes  in  achievement  was  conducted  as  part  of  the  provincial  assessment.  Results 
showed  that  achievement  in  reading  in  1995  was  significantly  better  than  in  either  1992  or  1988.  In  writing, 
results  show  a marginal  improvement  over  results  from  both  1992  and  1988. 


Part  A:  Writing 

Test  Blueprint 

The  blueprint  for  Part  A:  Writing  shows  the  reporting  categories  (scoring  guide),  a description  of  the  writing 
assignment,  and  the  standards. 


Reporting  Category 


Description  of  Writing 
Assignment 


Standards 


*Content  (selecting  ideas  and  details  to  achieve  a 
purpose) 

Events  and/or  actions  should  be  plausible  and 
appropriate  to  the  student’s  purpose.  The  student 
should  be  able  to  describe  characters  and  setting  that  are 
appropriate  within  the  context  of  terms  of  reference 
established  by  the  student. 


The  writing  assignment  follows  a 
writing  prompt,  both  of  which  the 
teacher  reads  aloud  to  the  students. 
The  assignment  allows  the  student 
to  select  the  format  that  wiU  best  fit 
his/her  approach  to  the  prompt. 


The  student’s  achievement  in 
each  reporting  category  wiU  be 
described  according  to  the 
foUowing  standard  statements: 

— meets  the  standard  of 
exceUence 


^Organization  (organizing  details  into  a coherent 
whole) 

The  student  should  be  able  to  place  events  in  a coherent 
sequence. 


Sentence  Structure  (structuring  sentences  effectively) 

The  student  shotild  be  able  to  use  a variety  of  sentence 
structures  effectively  in  writing. 


— approaches  the  standard  of 
exceUence 

— clearly  meets  the  acceptable 
standard 

— does  not  clearly  meet  the 
acceptable  standard 

— clearly  below  the  acceptable 
standard 


Vocabulary  (selecting  words  and  expressions  correctly 
and  effectively) 

The  student  should  be  able  to  use  words  and  expressions 
effectively  in  writing. 


INS — insufficient 


Conventions  (using  the  conventions  of  written  language 
correctly  and  effectively) 

The  student  should  be  able  to  communicate  clearly  in 
writing  by  adhering  to  appropriate  spelling,  grammar, 
punctuation,  and  capitalization. 


*These  categories  were  weighted  to  be  worth  twice  as  much  as  each  of  the  others. 
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Observations  and  Results 

Although  the  overall  quality  of  the  writing  in  English  Language  Arts  in  1995  is  quite  comparable  to  that 
done  in  1992  and  1988,  not  enough  students  are  meeting  provincial  standards.  The  papers  written  this  year 
were  much  longer  than  those  done  in  the  past;  however,  quantity  is  not  indicative  of  quality.  Many  students 
had  difficulty  isolating  significant  and/or  interesting  details  from  superfluous  information. 

Teacher  markers  generally  found  that  students  were  able  to  demonstrate  their  knowledge  of  story  structure. 
As  well,  students’  writing  generally  demonstrated  an  awareness  of  audience.  Vocabulary  was  another  area 
that  showed  real  strength. 


Some  students  wrote  clearly  excellent  papers.  These  were  lively,  imaginative,  and  technically  very  well 
written.  The  quality  of  these  papers  far  exceeded  the  expectations  of  students  in  a Grade  6 classroom. 

Part  B:  Reading 

Test  Blueprint 

The  blueprint  for  Part  B:  Reading  shows  the  reporting  categories  and  language  function  under  which 
questions  are  classified. 


Question  Distribution  by 
Language  Function 

Number  of 

Reporting  Category 

Informational 

Narrative/Poetic 

Questions 

Main  Ideas/Details 

The  student  should  be  able  to  recognize  explicit  and  inferred 
or  implicit  relationships  among  settings,  events,  characters, 
and  ideas,  and  identify  growth  or  change  in  fictional 
characters. 

1,  5,  25,  28, 
43,  45,  46 

8,  9,  10,  21,  37,  38, 
41 

14 

Organization  of  Ideas  and  Relationships  between 
Form  and  Content 

The  student  should  be  able  to  identify  genre  and  elements  of 
story  structure,  recognize  the  author’s  techniques,  deterrnine 
the  author’s  purpose,  and  use  text  and  typographical 
features  to  assist  reading. 

26 

6,  19,  22,  40,  49 

6 

Associating  Meaning 

The  student  should  be  able  to  associate  meanings  of  words 
and  expressions  from  prior  knowledge  and  contextual  clues, 
understand  the  denotations  and  connotations  of  words  and 
expressions,  and  determine  the  meaning  and  effect  of  the 
more  common  types  of  figurative  language. 

4,  27,  29,  44, 
47 

7, 11,  12, 13, 14,  33, 
34,  39 

13 

Sjnithesizing  Ideas 

The  student  should  be  able  to  draw  conclusions,  make 
generalizations,  and/or  predict  plausible  outcomes  by 
synthesizing  information  from  the  entire  reading  selection. 

2,  3,  30,  48 

15,  16,  17,  18,  20, 
23,  24,  31,  32,  35, 
36,  42,  50 

17 

Number  of  Questions 

17 

33 

50 
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Observations  and  Sample  Questions 

The  following  is  a discussion  of  specific  areas  of  strength 
and  weakness  for  students  in  Grade  6 classrooms.  Sample 
questions  from  the  test  are  provided  to  highlight  these  areas 
for  students  meeting  the  acceptable  standard  and  for  those 
meeting  the  standard  of  excellence  for  reading.  For  each 
sample  question,  the  keyed  answer  is  marked  with  an 
asterisk.  These  questions  are  no  longer  secured  and  will  not 
be  reused  in  1996. 


10.  When  the  scientists  cannot  find  life  on  the 
nearest  planet,  they  feel 

A.  angry 

B.  uncertain 

C.  frustrated 
*D.  disappointed 


7.  The  phrase  “exhaustive  studies”  (line  3) 
means  that  the  studies  were 


*A. 

complete 

B. 

scientific 

C. 

important 

D. 

interesting 

Acceptable  Standard 

For  question  10,  students  had  to  locate  key  details  of 
character  motivation  in  a passage.  Of  students  who  met  the 
acceptable  standard,  87%  were  able  to  do  this. 

In  question  7,  many  students  meeting  the  acceptable 
standard  had  difficulty  inferring  the  meaning  of  an 
expression  from  its  context  in  a play.  Approximately  40%  of 
this  group  were  able  to  correctly  answer  this  question. 


The  strengths  of  students  who  met  the  acceptable  standard 
include  an  ability  to 

• understand  the  relationship  among  details  in  a reading 
selection 

• identify  directly  stated  details  of  setting  and  character 

• infer  character  motivation 


However,  many  of  these  students  did  not  do  as  well  as 

expected  in 

• inferring  the  meaning  of  words  and  phrases  from  the 
context  of  the  materials  (see  question  7) 

• making  judgements  about  character  motivation  by 
synthesizing  information  in  a reading  selection 

• drawing  conclusions  by  synthesizing  pertinent  details 
from  a reading  selection 

• interpreting  key  details 

• understanding  selections  that  were  not  narrative  in  form 
(particularly  poetry  and  cartoons) 
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Standard  of  Excellence 

Students  meeting  the  standard  of  excellence  had  no 
difficulty  with  the  following  questions,  which  tended  to  be 
difficult  for  those  students  meeting  the  acceptable  standard. 

Question  42  required  students  to  draw  a conclusion  by 
S5nithesizing  information  in  a passage.  Of  students  meeting 
the  standard  of  excellence,  a little  over  96%  answered  this 
question  correctly. 

Question  30  required  students  to  draw  a conclusion  about 
character  motivation  by  synthesizing  information  in  a poem. 
Of  those  students  meeting  the  standard  of  excellence,  a 
little  over  95%  answered  this  question  correctly. 

Students  who  met  the  standard  of  excellence  had  very  few 
difficulties  with  this  assessment.  These  students  could 

• synthesize  information  from  a selection  to  make 
inferences,  judgements,  and  draw  conclusions 

• recognize  the  meaning  of  words  and  phrases  from  the 
context  of  the  material 

• make  judgements  about  the  author’s  purpose 

• understand  the  author’s  point  of  view 

• understand  the  selections  that  were  not  in  narrative  form 
(poems  and  cartoons) 

Comments 

Student  Collaboration  Time  Before  Writing 

This  year,  for  the  first  time,  students  were  allowed  to  discuss  the  writing  prompt  with  classmates  before 
writing.  The  majority  of  the  teachers  said  that  this  is  a very  positive  change  because  it  reflects  classroom 
practice  and  it  provides  a “comfort  zone”  for  many  students  who  suffer  from  test  anxiety.  This  practice  will 
be  continued  in  the  1996  assessment. 

Local  Marking 

Also  for  the  first  time  this  year,  teachers  were  allowed  to  mark  their  own  students’  papers  before  returning 
them  for  central  marking.  Initial  results  are  very  encouraging.  Approximately  30%  of  the  papers  were 
marked  locally  and  scores  submitted  to  Alberta  Education.  A high  level  of  reliability  was  achieved  for  these 
papers.  Papers  found  to  be  discrepant  between  first  and  second  readings  were  given  a third  adjudicating 
read.  The  third  reading  rescore  rate  was  less  than  8%.  As  more  teachers  have  the  opportunity  to  become 
familiar  with  the  provincial  scoring  criteria  and  standards,  we  expect  that  the  number  of  teachers  marking 
locally  will  increase. 


42.  When  Summer  told  Winter  to  be  “less  severe” 
with  his  power  (lines  41-42),  she  meant  that 
he  should 

A.  share  his  power 

B.  go  away  for  six  months 
*C.  not  be  so  cold  and  harsh 

D.  agree  with  her  decision 


30.  On  the  trip,  Jason  was  afraid  when  he  thought 
that  the 

A.  plane  would  run  out  of  fuel 
*B.  plane  would  break  through  the  ice 

C.  group  had  nowhere  to  stay  the  first  night 

D.  other  travellers  would  get  to  the  Pole  first 
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Draft  Versus  Final  Copy 

Many  teachers  suggested  that,  in  the  future,  students  should  be  allowed  to  complete  one  copy  of  their 
writing,  with  revisions  made  directly  on  that  copy.  In  the  past,  when  both  draft  and  final  copies  were 
required,  most  students  would  just  recopy  their  original  work,  paying  special  attention  to  neatness  rather 
than  to  improving  the  content  or  accuracy  of  what  they  had  originally  written.  For  1996,  we  will  expect  a 
good  first  draft,  preferably  double  spaced  to  accommodate  changes  more  readily. 

Resolving  Administration  Anomalies 

Although  we  announced  the  new  practice  of  reusing  items  from  1992,  1993,  or  1994  tests,  and  the  securing  of 
these  tests  as  late  as  October  1994,  most  schools  were  able  to  respond  quickly  and  were  successful  in 
avoiding  the  use  of  these  tests  with  students.  Consequently,  the  1995  testing  was  conducted  effectively 
throughout  Alberta  without  compromising  the  validity  of  the  results.  In  a few  schools,  however,  questions 
were  raised  about  students’  prior  access  to  the  test  items  and  concerns  were  rightfully  expressed  about 
fairness  and  accuracy.  Superintendents  were  asked  to  investigate,  along  with  school  principals  and 
teachers,  these  and  all  other  non-standard  testing  practices  brought  to  our  attention  and  to  make 
recommendations  about  the  validity  of  results.  Initially,  1062  student  results  for  Grade  6 Language  Arts 
were  reported  as  “not  available,”  pending  further  investigation  due  to  validity  concerns.  In  the  end,  results 
for  only  1 student  was  determined  to  be  invalid  for  Grade  6 Language  Arts. 

Release  of  Secured  Items 

As  outlined  in  the  General  Information  Bulletin,  items  from  the  achievement  tests  are  secured  except  those 
that  are  released  each  year  in  the  subject  area  bulletins.  The  items  in  these  bulletins  may  be  used  to 
prepare  students  for  the  provincial  assessment.  The  subject  area  bulletins  are  mailed  to  all  schools  in  the 
faU. 

Parent  Guide  to  Provincial  Achievement  Testing 

Last  spring,  we  sent  schools  copies  of  the  Parent  Guide  to  Provincial  Achievement  Testing  to  distribute  to 
parents  through  the  students  in  grades  3,  6,  and  9.  The  purpose  was  to  support  open  communication  about 
provincial  standards  and  the  testing  program  among  the  teacher,  the  student,  and  the  parent.  The  guide 
included  a tear-out  card  with  several  questions  and  space  for  comments.  Parents  returned  over  2000  cards; 
about  half  included  comments.  Parents’  feedback  about  the  learnings  expected  of  students,  the  quality  of 
questions  on  the  tests,  and  the  testing  program  was  generally  positive.  Their  written  comments  ranged  from 
positive  to  negative,  and  many  simply  asked  for  more  information.  As  parents  seemed  to  appreciate  this 
form  of  communication,  we  are  looking  for  a way  to  make  the  guide  available  again  later  this  school  year. 

Performance-Based  Assessment 

In  addition  to  writing  the  achievement  test,  a random  sample  of  students  from  across  the  province 
participated  in  performance-based  assessments  in  Language  Arts  3,  Mathematics  6,  and  Social 
Studies  9. 

Performance-based  assessment  reports  will  be  sent  to  participating  schools  and  a summary  of  provincial 
results  will  be  sent  to  all  schools  in  November  1995.  A “Samples  of  Student  Responses”  document  for  the 
performance-based  assessment  will  be  prepared  and  made  available  to  all  schools  in  the  spring  of  1996. 
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1995  Administration — A Note  of  Thanks 


National  Library  of  Canada 


Bibliptheque  nationa 


do  Canada 


3 3286  51029  4339 


We  at  Student  Evaluation  wish  to  express  our  appreciation  to  you,  the  principals  and  teachers  throughout 


Alberta,  for  the  care  and  attention  you  gave  to  the  administration  of  the  1995  achievement  tests.  Successful 
implementation  of  the  expanded  program  and  the  changes  in  procedures  and  rules  depended  on  your 
assistance  and  cooperation.  We  hope  that  you  find  the  changes  in  the  testing  and  the  additional  achievement 
information  helpful  in  your  work  with  students. 


Credits 

Cover  photograph  from  Practical  Ideas  for  Teaching  Writing  as  a Process.  Copyright  1986,  1987,  California 
Department  of  Education,  P.  O.  Box  271,  Sacramento,  CA  95812-0271.  Reprinted  by  permission. 


For  further  information,  contact  Jo-Anne  Hug,  Assessment  Specialist  or  Dennis  Belyk,  Assistant  Director  at 
403-427-0010.  The  toll-free  number  is  310-0000. 
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Printed  November  1995 


